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Abstract. Let C be a one- or two-sided Kazhdan-Lusztig cell in a Coxeter group 
(W, S), and let Reduced(C) be the set of reduced expressions of all w £ C, regarded 
as a language over the alphabet S. Casselman has conjectured that Reduced(C) is 
regular. In this paper we give a conjectural description of the cells when W is the 
group corresponding to a hyperbolic polygon, and show that our conjectures imply 
Casselman's. 



1. Introduction 

Let W be a Coxeter group with generating set S. In their study of representations 
of Coxeter groups and Hecke algebras, Kazhdan and Lusztig introduced the decom- 
position of W into cells [16] . The cells are equivalence classes in W determined by 
the left and right descent sets of elements of W and the degrees of the Kazhdan- 
Lusztig polynomials P x>y (^2f- Today cells are known to have many applications in 



representation theory; for some references, see the bibliography of 13 . 

The paper addresses the computability of the cells, in the following sense. Given 
a cell C, one can ask for an efficient way to encode its elements. Since elements of 
W are easily represented by reduced expressions in the generators S, it is natural to 
ask for a solution in terms of such expressions. However, since the definition of the 
cells involves a complicated equivalence relation, it is certainly not clear that this is 
possible. 

Despite this, W. Casselman has conjectured that cells can be efficiently encoded. 
To state his conjecture, we need some terminology from the theory of formal lan- 
guages; for more information see [I]. 

Let A be a finite alphabet of characters. By a language L over A we mean a 
collection of finite-length ordered words built from elements of A. A finite state 
automaton with alphabet A is a finite directed graph on a vertex set J^, called 
states, with edges labeled by elements of A U {e}. Different edges leaving a given 
vertex are assumed to have different labels. One vertex is defined to be the initial 
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state; a subset of 5? is chosen and defined to be the accenting states. A finite state 
automaton encodes certain words built from A through path traversal: one starts 
at the initial state and follows a directed path of any length that terminates at an 
accepting state. As the path is traversed the vertex labels are concatenated into a 
word (the symbol e represents a "null-transition;" the word is unaltered if e is read). 
The collection of words that can be so constructed forms the language recognized by 
srf ' . A language is called regular if it can be recognized by a finite state automaton. 

Regular languages are the simplest infinite languages one encounters in the hier- 
archy of formal languages. Many languages in algebra are regular. For instance, via 
an earlier paper of Davis-Shapiro |10|, work of Brink-Howlett implies that the lan- 
guage ReducedfW) of all reduced expressions in the generators S is regular [§]. Any 
cell C induces a sub language Reduced(C) C Reduced(iy), namely all the reduced 
expressions of elements in C. We can now state Casselman's conjecture: 

1.1. Conjecture. For any Coxeter group W and any (two- or one-sided) cellC C W , 
the language Reduced(C) is regular. 

Casselman's conjecture is known to be true for affine Weyl groups from earlier 
work of one of us (PG) (li). In this paper we investigate the case that (W, S) is 
a Coxeter group corresponding to a hyperbolic polygon. In other words, W can be 
realized as the discrete subgroup of isometries of the hyperbolic plane fj generated by 
the reflections through the side of a geodesic polygon. The cells of such groups have 
been considered earlier by Bedard [2,3] and one of us (MB) |2). We state conjectures 
due to two of us (MB and PG) that describes the Kazhdan-Lusztig cells of W in 
terms of reduced expressions. Then we prove (assuming the conjectures) that for any 
left, right, or 2-sided Kazhdan-Lusztig cell C, the language Reduced(C) is regular. 
Moreover, when combined with previous work of two of us (MB and PG), the results 



in this paper prove the regularity of cells for certain Coxeter groups (cf. Remark 5.5). 
We note that the proofs in this paper use word-hyperbolicity of W in an essential 
way, and in particular do not apply to affine Weyl groups. 

We now give an overview of the paper. In §[2]we give background on Coxeter groups 
and recall the definition of Kazhdan-Lusztig cells. Section [3] states conjectures for 
cells in Coxeter groups attached to tessellations of the hyperbolic plane by polygons. 
In §[4] we give background on word hyperbolic groups and state the results we need 
from geometric group theory. Finally £[5] gives our main results. 

2. Definitions and basic examples 

In this section we recall the basics of Coxeter groups and define Kazhdan-Lusztig 
cells. For more details we refer to [6 15, 16 



A Coxeter group W is a group generated by a finite subset S C W where the 
defining relations have the form (st) m ^ s '^ = 1 for pairs of generators s,t E S. The 
exponents m(s, t) are taken from PJ U {oo}, and we require m(s, s) = 1, so that each 



CELLS AND AUTOMATA 



3 



generator s is an involution. Let / C S be a subset of the generators. The subgroup 
of W generated by / is called a parabolic subgroup and is denoted Wj. 

Any representation of w G W as a product of generators is called an expression. 
An expression is called reduced if it cannot be made shorter by applying the defining 
relations of W. The length of a shortest expression for w is denoted l(w). For any 
w G W, we define the left descent set ££(vS) C S to consist of those s G 5 such that 
l(sw) < l(w). We similarly define the right descent set M{w) to be those s such that 
l(ws) < l(w). 

Given an expression si • • • sjy, a subexpression is a (possibly empty) expression of 
the form • • • s iM , where 1 < i\ < ■ ■ ■ < %m < N. The Chev alley -Bruhat order is 
the partial order on W defined by putting v < w if an expression for v appears as a 
subexpression of a reduced expression for w. Given any v, w G W, let [v,w] be the 
interval between v and w, that is [v , w] = {x G W \ v < x < w}. 

The Kazhdan-Lusztig polynomials are most easily defined in terms of an auxiliary 
family of polynomials, the R-polynomials. This family {R v , w {q) 6 Z[g] | v, w G W} is 
defined to be the unique collection of polynomials satisfying the following properties 
(cf. [6j Theorem 5.1.1]): (i) R VyW (q) — if v ^ w; (ii) R V:W (q) — 1 if v — w; and (iii) 
if s G M(w), then R VtW (q) = R vs<ws (q) if s G ^(u), and is qR vs<ws (q) + (q- l)R v , ws (q) 
otherwise. Given the .R-polynomials, the Kazhdan-Lusztig polynomials P V)W (q) can 
be described as the unique family of polynomials satisfying (cf. [6j Theorem 5.1.4]) (i) 
P v ,w{q) = if v £ w) (ii) P v ,w{q) = 1 if v = w; (iii) degP„, w (g) < (l(w) - l(v) - l)/2 
if u < w; and (iv) q l ^~ 1 ^ P^q' 1 ) = J2 x e[v, w ] RvM P *,M $ v < w. If v < w, 
we write fj,(v,w) for the coefficient of g^w-K")- 1 )/ 2 i n P VAU (q). We write t> — n> and 
iy — 1> if /i(t>, it?) 7^ 0. 

We are finally ready to define cells. The left W -graph of W is the directed 
graph with vertex set W, and with an arrow from v to w if and only if v — w and 
■5?{v) <f. <Sf(w). The left cells are extracted from T% as follows. Given any directed 
graph, we say two vertices are in the same strong connected component if there exist 
directed paths from each vertex to the other. Then the left cells of W are exactly the 
strong connected components of the graph F <£. The right cells are defined using the 
analogously constructed right W -graph We say v,w are in the same two-sided 
cell if we can find a sequence v = w\, u>2, • • • , uik = w such that Wi, Wi+i lie in either 
the same left or right cell. 

We need one final ingredient to state our conjecture in the next section: the a- 
function. 

Let Jf? denote the Hecke algebra of W over the ring srf = Zfg 1 / 2 , q^ 1 ^ 2 ] of Laurent 
polynomials in g 1//2 . This algebra is a free ^-module with a basis 2? = {T w \ w G W} 
and with multiplication determined by T W T W / = T ww > if l{ww') = l(w) + l(w'), and 
T 2 = q+ (q — 1)T S for s G S. Together with the basis we can define in Jtf another 
basis ^ = {C w | w G W}. The element C w G ^ can be expressed in terms of and 
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the Kazhdan-Lusztig polynomials by 

y<w 

Now consider the multiplication of the ^-basis elements in Jtf. We can write 

C X Cy ^ h X y Z C Z 1 h X y Z G . 

Z 

Let a(z) be the smallest integer such that q a ^ z ^ 2 h Xi y jZ G for all x,y G W, where 
£/ + = Zfg 1 ' 2 ]. It is a standard conjecture that {a(w) | w G W 7 } C Z is bounded 
for any Coxeter group. The a-function was introduced by Lusztig in 18 , where 
he proved this conjecture for affine Weyl groups. In |4| it was shown that the a- 
function is bounded for right-angled Coxeter groups. N. Xi recently showed that the 
a-function is bounded for Coxeter groups with complete Coxeter graphs (i.e. no two 
generators commute) (20); this paper has further ramifications for our current article, 



has rank 3 |21|. 



see Theore m |3.2 P. Zhou has recently proved that the a-function is bounded if W 



3. Conjectures about cells of hyperbolic polygon groups 

In this paper we take W to be a hyperbolic polygon group. This means the follow- 
ing. Let be the hyperbolic plane, and let A C $) be an n-sided geodesic polygon 
with angles = ir/a,i, i = 1, . . . ,n. (We omit the conditions the denominators a, 
satisfy to make A hyperbolic; we also allow the angles to vanish, in which case the 
polygon has ideal vertices.) Label the sides of A by ai, . . . , a n , such that the angle at 
sits between the sides <Tj, <7j+i, and where the subscripts are taken mod n as necessary. 
Then the generating set S of W has n elements Si, . . . s n , corresponding to the sides 
(jj. We put m(si, Sj) = oo unless Oi and meet at the angle ^ 0. In the latter 
case we put m(si, Sj) = a*-. 

It is not hard to see that W is isomorphic to the discrete subgroup of isometries 
of i} generated by reflections in the lines through the cij. Thus there is an action of 
W on S") by reflections, the polygon A is a fundamental domain, and the translates 
{w ■ A | w G W} form a tessellation of fj (note our convention that the reflection 
action of W on fj is a left action). The correspondence w i— >■ w ■ A is a bijection 
between W and the tiles in the tessellation. Using this we identify W with the set of 
all tiles. 

We can also use this identification to define certain subsets of W. Recall that 
Ji?(w) denotes the set of left descents of an element w. Given any subset T C S, 
we let W T be the (possibly empty) set of all w G W such that Jzf(io) = T. The 
tessellation allows us to identify the sets W T as follows. First, W consists of A 
itself. Next, any edge of A corresponds to a generator s G S. Extending this edge to 
a line divides the plane ft into two half-spaces, one containing A and one not. The 
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half-space H s not containing A contains all elements w such that s G ^(w). Any 
(non-ideal) vertex of A corresponds to an order 2 subset T with W T ^ 0. Namely 
we have W T = H s n H s >, where T = {s, s'} and s, s' label the edges of A meeting 
this vertex. Finally, if T,T' have order 2 and T D T" — {s} has order 1, then 
consists of H s \ W T D W T . These give all subsets T such that W T ^ 0. 

We call a subgroup D C W finite dihedral if D is the parabolic subgroup for an 
order 2 subset T with VT T nonempty. Let *2J be the set of finite dihedral subgroups 
and let be the set of order 2 subsets indexing them. For any Del, let wd be the 
longest element. Assume that the distinct nonzero exponents are e% < e-i < • • ■ < e m , 
where m < n. This means there are m isomorphism classes of dihedral subgroups of 
W. We write ^ = f i U ■ ■ • U @ m , where ^ is the set of finite dihedral subgroups of 
exponent ej. We also let & = 3\ U • • • U 2? m be the corresponding partition of £F . 
For % = 1, ... ,m let Wi = {% | D G ^} be the sets of longest elements. Hence 
wd G Wi if and only if D has exponent e,. Finally let be the common length of the 
elements in Wi. 

We are now ready to give a conjectural description of the two-sided cells of W. Let 
C m , . . . , Ci C W be the sequence of subsets defined by 

w G C m if and only if w = u.Wd-v for some Wd £ W 7 ™, 

and if i < m, 

w G Ci if and only if w = u.Wd-v for some Wd G Wj, 

and w 7^ u.Wd-v for any G H^fc with k > i. 

Here we write z = x.y in if z = xy and Z(z) = l(x) + l(y). We also define subsets 
Cid = {id} and 

Cq = {w | w has a unique reduced expression}. 
Let 'io be the collection {Cid, Co, ■ ■ ■ , C m }. 

3.1. Conjecture. (1) The decomposition gives the partition of W into two- 
sided cells. 

(2) The a-function equals U on the two-sided cell Ci. 

Figure [T] shows an example of the partition ^€ for the triangle group 

W 237 = (r, s, t | r 2 = s 2 = t 2 = (rs) 3 = (rt) 2 = (st) 7 = 1). 

There are three finite dihedral subgroups, of orders 4, 6, 14, corresponding to the 
exponents 2,3,7. The subsets Cz,C2,Ci are (respectively) the red, blue, and green 
triangles. Finally the grey triangle is C^ and the yellow triangles are Cq. 

We remark that both C^ and Cq are known to be two-sided cells, the former for 
trivial reasons and the latter from work of Lusztig (TtI §§3.7-3.8]. We also have the 



following theorem of Xi, which gives confirmation of Conjecture 3.1 for certain W, 
not necessarily hyperbolic: 




Figure 1. The triangle group W : 



237 



3.2. Theorem. [20] Suppose W is crystallographic and that no exponent of W is 2. 
Then c io gives the partition of W into two-sided cells. 

Next we turn to the one-sided cells. Given any T G define 



U 1 



w 1 



IK- 



j>i 



In particular if i — m, we have U T = W T . Let Qi = {w^ 1 \ w G C{\. The one-sided 
cells will be built from the sets w ■ U T , where w G Qi and T ranges over We put 
a partial order on 8 by w ^ ?/ if /(w;) < /(y) and there exists T, T" G ^ such that 
(w ■ £/ T ) fl (?/ • U T ) 0. We define to be the minimal elements in (1; with respect 
to this partial order. 



3.3. Conjecture. The subsets {w ■ U 



T 



w G 



f2°,T G are the right cells in Ci 



red region in Figure 2 (a 
U T = U 23 , where T 



Figures 2(a) -2(b) illustrate Conjecture 3.3 for W237 and the two-sided cell C 3 . The 



together with the purple triangles inside it, is the subset 
(32,83). This is a one-sided cell in C3. The purple triangles 



are the elements in Q3. In Figure 2(b) we see the translates w ■ U 23 as w ranges over 
^3. Note that some regions meet others; indeed, if this happens then one translate 
of U 23 is entirely contained in another. The elements of correspond to the purple 
triangles in Figure [2(a) that lie at the ends of the orange regions. The orange regions, 
together with the purple triangles in them, are the other one-sided cells in C3. 

Conjectures [33] and 3.1 should be considered as a special case of conjectures from (5] 
applied to hyperbolic polygon groups. 



4. Word hyperbolic groups and automata 



In this section we prove that certain languages in word hyperbolic groups are 
regular. We will then apply these results to the languages Reduced(C) where C is a 
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(a) U 23 and fl 3 



(b) The translates U 23 ■ 



Kazhdan-Lusztig cell in a hyperbolic polygon group. First we define word hyperbolic 
groups and recall some of the standard facts we shall need. Details and additional 
properties can be found, for example, in [7, 12 . 

Let (X, d) be a geodesic metric space. A geodesic triangle consists of 3 points in 
X together with geodesies joining each pair of points. A geodesic triangle is called 
S -thin (5 G M>o) if every side is in a 5-neighborhood of the other two sides. The 
metric space X is called 5-hyperbolic if every geodesic triangle is 5-thin. 

Given a group W and a generating set S, we let C&y(W, S) denote the correspond- 
ing Cayley graph, which we regard as a geodesic metric space by identifying each 
edge with a unit length interval. Note that the metric restricts to the word metric 
ds '■ W x W — > Z>o on the vertices of the Cayley graph; that is, for any u,v G W 
the distance ds(u,v) is the minimal length of a geodesic from u to v in Cay(W, S). 
We define the length of an element w G W by l(w) = ds(l,w). 

4.1. Definition. A finitely generated group W is word hyperbolic if for some (equiv- 
alently, any) finite generating set S, there exists a 5 such that C&y(W, S) is 5- 
hyperbolic. 

It is known that a word hyperbolic group cannot contain a subgroup isomorphic 
to Z x Z. For Coxeter groups, this condition is also sufficient. 



4.2. Proposition. [9j Corollary 12.6.3] A Coxeter group W is word hyperbolic if and 
only if it contains no subgroup isomorphic to Z x Z. 

In particular, if a Coxeter group W is a lattice in the isometry group of f} (for 
example, a hyperbolic polygon group), then W is word hyperbolic. 

The key property of hyperbolic groups that we shall need is the fellow-traveler 
property. For a group W with generating set S, we let S* denote the language of all 
words over the alphabet S. Any word a G S* determines a path in C&y(W, S) that 
starts at the identity vertex 1 G W. We let |a| denote the length of this path and 
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a G W denote the terminal vertex. Keeping the terminology for Coxeter groups, we 
say that a word a G S* is an expression for wEWifa = w. (Note that S = S" 1 , so 
that every element of W is represented by some a G S*, i.e. so that the map ai->« 
from S* to W is surjective.) An expression a for w is a reduced expression for w if 
the corresponding path in C&y(W, S) is a minimal length geodesic between 1 and w. 
In other words, a satisfies |a| = ds(l,w) = l(w) and a = w. 

A subset L C S* is called a normal form for W if the map a4a from L to is 
surjective. The normal form we are interested in most is the geodesic normal form, 
denoted by Reduced(W / ), consisting of all reduced expressions for all elements in W. 
More generally, for any subset X C W, we define Reduced(X) to be the set of all 
reduced expressions for elements of X. 

Two words a, (3 G S* with \a\ < \(3\, can be written uniquely as a = S1S2 ■ ■ ■ s n and 
P = t\t2 ■ ■ - t n+p where Si,tj G S. We say that a and /3 are (synchronous) k-fellow- 
travelers if ds(sl ■ ■ ■ s iy tx ■ ■ ■ t 4 ) < k for all i — 1, . . . , n and d s (si ■ ■ ■ s n , t± ■ ■ ■ t n+i ) < k 
for i — 1, . . . ,p. In other words, the corresponding paths for a and j3 in the Cayley 
graph are never more than k- apart. 

4.3. Definition. Given a group W with generating set S, a normal form L C S* is said 
to have the fellow-traveler property (respectively, two-sided fellow-traveler property) 
if there exists a k > such that for any a, (3 G L with a — (3t for some t G S U {1} 
(resp., a = sat for some s,t G S U {1}), the words a and /3 are fc-fellow-travelers. 

4.4. Remark. The (two-sided) fellow-traveler property for a normal form L is known to 
be equivalent to W having an automatic structure (resp., biautomatic structure) with 
respect to L in the sense of [TT] . In particular, such a normal form must be recognized 
by a finite-state automaton, hence is a regular language. Obviously, biautomatic 
implies automatic. 

The key fact we shall need is that word hyperbolic groups are biautomatic with 
respect to the geodesic normal form. 

4.5. Proposition. If W is word hyperbolic, and S is any finite generating set, then 
Reduced(iy) has the two-sided fellow-traveler property. 

Proof. The two-sided fellow-traveler property is equivalent to both the normal form 
and its inverse language having the (one-sided) fellow-traveler property (TTJ Defini- 
tion 2.5.4 and Lemma 2.5.5]. Since the geodesic language is closed under taking 
inverses, it is enough to show that Reduced(iy) satisfies the fellow-traveler property, 
and this is well-known (TTJ Theorem 3.4.5]. □ 

5. Hyperbolic polygon cells and regular languages 



In this final section we prove our main results, Theorems 5.1 and 5.3 The first 
uses only the one-sided fellow traveler property, but the second requires the stronger 
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two-sided property. We then combine them with Conjectures [3TT and 3J3 to deduce 
the regularity of certain Kazhdan-Lusztig cells. 

Given a group W and finite generating set S, let \i be any reduced word in S*. As 
above, we write w = u.v in W if w = uv and l(w) = l{u) + l(v). We then define the 
subset X M of W by 

= {w eW \ w = u.Jl.v for some u, v € W}. 

In other words, consists of all elements of W that have some reduced expression 
containing \i as a (consecutive) subword. The language Reduced(X A1 ) therefore con- 
sists of all reduced expressions that are equivalent to a reduced expression containing 
li as a subword. 

5.1. Theorem. Let W be a word hyperbolic group, let S be any finite generating set 
S satisfying S = S 1-1 , and let \x be any word in Reduced(W). Then Reduced(X M ) is 
a regular language. 

Proof. Since W is word hyperbolic, Reduced(W) is a regular language. The sublan- 
guage Reduced^ (W) consisting of all reduced words that contain \x as a subword (i.e., 
that match the regular expression . * fi.*) is also a regular language. 

Now let A be a finite state automaton accepting Reduced(H / ), and let k be a 
positive integer such that Reduced(W / ) has the fc-fellow-traveler property. Let Nk 
be the set of all reduced expressions in S* with length < k. Then the standard 
automaton M e based on (A,Nk) (see [ll] Definition 2.3.3]) accepts the language 

L = {(a, (3) G Reduced(H / ) 2 | a = (3 and a and (3 are fc-fellow travelers}, 

which is therefore regular. But since Reduced(W / ) satisfies the fc-fellow-traveler prop- 
erty, this language consists precisely of pairs of reduced expressions having the same 
image in W, i.e., 

L = {(a,p)e Reduced s (WO x Reduced 5 (VT) | a = /?}. 

The language Reduced(X At ) is obtained by intersecting L with the language Reduced(W / ) x 
Reduced^ jy) and then projecting onto the first factor. By standard predicate calcu- 
lus for regular languages (see, e.g., 11, Theorem 1.4.6]), the language Reduced(X M ) 



is therefore regular. □ 
5.2. Corollary. Let W be a hyperbolic polygon group, and let C be a conjectural two- 



sided cell in the decomposition ^ of Conjecture 3.1. Then the language Reduced(C) 
is regular. 

Proof. For each finite dihedral subgroup D, let lid be any reduced expression for the 
longest element we>. Then 

Reduced(C m ) = Reduced(X /tD ), 
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and for 1 < i < m, 

Reduced(Ci) = [J Reduced(X MD ) \ [J Reduced(C i ). 

~p D £Wi i<j<m 

Since these are all obtained using finite unions, complements, and intersections of 
regular languages, they are regular. For Reduced(Cid) and Reduced(Co), we note that 
the former is finite, and the latter is the complement of Reduced(Cid) UReduced(Ci) U 
• • • U Reduced(C m ) in Reduced(W). It follows that both are regular as well. □ 

5.3. Theorem. Let W be a word hyperbolic group, and let S be any generating set. 
Suppose X C W is such that Reduced(X) is a regular language. Then for any w G W, 
the language Reduced^ • X) is also regular. 

Proof. In fact, the theorem holds for any normal form on a group that satisfies the 
two-sided fellow-traveler property (i.e., is biautomatic). The proof is fairly immediate 
from the definitions; a reference is [l9[ Lemma 1.2]. □ 



5.4. Corollary. Let W be a hyperbolic polygon group and let w ■ U T (for w G Q° and 
T G ,%) be one of the conjectured one-sided cells in Cj. Then Reduced^ • U T ) is 
regular. 

Proof. First, we claim that the language Reduced(W T ) is regular. This is easily seen 
using the canonical automaton £>4 an that accepts Reduced(jy) [6J Theorem 4.8.3]. 
The states of this automaton, all of which are accepting, are given by the regions 
that are the connected components of the complement of the hyperplane arrangement 
determined by the small roots [6j §4.7]. Since the simple roots are small, the subset 
of the tessellation of S) corresponding to W T is given by a union of states of ^ a n- 
Hence we can make an automaton accepting Reduced(W T ) by starting with srf can 
and only making certain states accepting. Thus Reduced(W /T ) is regular. Since all 
of the Reduced(Cj) are regular, it follows that Reduced([/ T ) is regular. Hence, by 



Theorem 5.3, Reduced(w • U T ) is also regular. □ 



5.5. Remark. Conjectures 3.3 and 3.1 are true for right-angled polygon groups by [I], 



and more generally for polygons with equal angles that satisfy the crystallographic 
condition by |5j §4] . Thus we can apply the results of this section to show regularity 
of the languages attached to the cells for those groups. 
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